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IMEC328.001AUS PATENT 
EMBEDDED MULTIPLE DESCRIPTION SCALAR QUANTIZERS FOR 
PROGRESSIVE IMAGE TRANSMISSION 



5 Background of the Invention 

Field of the Invention 

The present invention relates to communication of digital signals, more 
particularly to a method and a device for transmission and/or reception of digital signals 
using diversity (e.g. Multiple Description Coding - MDC) to overcome channel 
10 impairments, as well as to the signals themselves and a network for transmitting and 
receiving the signals 

Description of the Related Technology 

A new family of communication services involving the delivery of image data 

1 5 over bandwidth limited and error prone channels as packet networks and wireless links 
has emerged in the last few years. In order to increase the reliability over these types of 
channels, diversity is commonly resorted to, besides error correction techniques. Multiple 
Description Coding (MDC) has been introduced to efficiently overcome channel 
impairments over diversity-based systems allowing decoders to extract meaningful 

20 information from a subset of a bit-stream. 

In his PhD. Thesis, which can be found in electronic format on 
http://lcavwww.epfl.ch/-goyal/Thesis/ , Vivek K. Goyal offers an overview of MDC in 
general and achievable rate-distortion regions. The focus of previous research was laid on 
finding the optimal achievable rate-distortion regions and their boundaries, as described 

25 in L. Ozarow, M 0n a source coding problem with two channels and tree receivers," Bell 
Syst Tech. J., vol. 59, pp. 1909-1921, 1980, and in A. A. El Gamal and T. M. Cover, 
"Achievable rates for multiple descriptions," IEEE Trans. Inform. Tk, vol. IT-28, no. 6, 
pp. 851-857, 1982. This is followed by the design of practical compression systems to 
meet these theoretical boundaries. Examples include methods based on quantization as 

30 described in V. A. Vaishampayan, "Design of multiple description scalar quantizers," 
IEEE Trans. Inform. 77z., vol. 39, no. 3, pp. 821 - 834, 1993, and in V. A. Vaishampayan 
and J. Domaszewicz, "Design of entropy-constrained multiple description scalar 
quantizers," IEEE Trans. Inform. Theory, vol. 40, no. 1, pp. 245-250, 1994, and methods 



based on multiple description transform as described in J. Batllo and V. Vaishampayan, 
"Asymptotic performance of multiple description transform codes, " IEEE Trans. Inform. 
Theory, vol. 43, no. 2, pp. 703-707, 1997, and in V. Goyal, J. Kovacevic, R. Arean, and 
M. Vetterli, "Multiple description transform coding of images," Proc. IEEE Int. Conf 
5 Image Proc. ICIP'98, pp. 674-678, 1998. A design of Multiple Description Scalar 
Quantizers (MDSQ) is pioneered in V. A. Vaishampayan, "Design of multiple description 
scalar quantizers," IEEE Trans. Inform. Th, vol. 39, no. 3, pp. 821 - 834, 1993 under an 
assumption of fixed length codes and fixed codebook sizes. Significant improvements are 
achieved in V. A. Vaishampayan and J. Domaszewicz, "Design of entropy-constrained 

10 multiple description scalar quantizers," IEEE Trans. Inform. Theory, vol. 40, no. 1, pp. 
245-250, 1994 where the design of the quantizers is subject to the constraint of a given 
entropy, and not of a given codebook size. 

In order to achieve robust communication over unreliable channels the MDC 
system has to deliver highly error-resilient bit-streams characterised by a corresponding 

15 high level of redundancy. Additionally, a fine grain scalability of the bit-stream is a 
desirable feature for bandwidth varying channels. A system conceived so as to meet these 
requirements is described in T. Guionnet, C. Guillemot, and S. Pateux, "Embedded 
multiple description coding for progressive image transmission over unreliable channels," 
Proc. IEEE Int. Conf Image Proc, ICIP 2001, pp. 94 - 97, 2001, where a progressive 

20 MDC algorithm is based on Multiple Description Uniform Scalar Quantizers (MDUSQ). 
Moreover, for a high level of redundancy and for low bit-rates, the approach of this 
document outperforms the embedded MDC algorithm based on a polyphase transform as 
proposed in W. Jiang and A. Ortega, "Multiple description coding via polyphase 
transform and selective quantization," Proc. SPIE Int. Conf. Visual Comm. Image Proc, 

25 VCIF99, San Jose, USA, pp. 998-1008, 1999. 

The system proposed in V. A. Vaishampayan, "Design of multiple description 
scalar quantizers," IEEE Trans. Inform. Th., vol. 39, no. 3, pp. 821 - 834, 1993, relies on 
the ability to design scalar quantizers with nested thresholds. A source signal or input 
signal, generally called "a source", represented by a random process {X n , *ez + } with zero 

30 mean and variance a 2 x is quantized by side quantizers q% {0,1,.. .,£-1}, m being a 
value between 1 and the number of side quantizers available, for example m = 1, 2, and K 
being the number of quantization intervals of a side quantizer for a quantization level. In 
the example given with two side quantizers, each of the two quantizers outputs an index 



q?,kez + for a quantization level, which indexes can be separately used to estimate the 
source sample. A reconstruction where Qg(x) = tf must be the centroid of the cell or 
quantization interval Qs~\q?)- If both indices Q\(x) = q\ and 2l«=<?* are received, the 
reconstruction is the centroid of the intersection Qt\q\,q 2 k )= QY\q\)(\Qf\ql) represented by 
5 the central inverse quantizer. The number of diagonals covered in the index assignment 
matrix triggers the redundancy between the two descriptions, as described in V. A. 
Vaishampayan, "Design of multiple description scalar quantizers," IEEE Trans. Inform. 
Th, vol. 39, no. 3, pp. 821 - 834, 1993. 

Quantization methods based on embedded scalar quantizers are previously 

10 proposed in the literature - see for e.g. D. Taubman and M. W. Marcellin, JPEG2000 - 
Image Compression: Fundamentals, Standards and Practice. Hingham, MA: Kluwer 
Academic Publishers, 2001. In embedded quantization, the partition cells or quantization 
intervals at higher quantization rates are embedded in the quantization intervals at lower 
rates. A quantization rate relates to the number of quantization intervals at a quantization 

15 level. A set of embedded side quantizers g^ 1 ,..., Qs> p with m=u the number of side 
quantizers, and P+l the number of quantization levels, and a set of embedded central 
quantizers <? c , Qh , q? where Qf\q\^QY~\q\)^ p '\ql) for any quantization level 
P , o< P <p are assumed. The number of quantization levels may be freely selected e.g. 
seven or more or ten or more levels. The quantization intervals of any quantizer q%> p and 

20 qp are embedded in the quantization intervals of the quantizers Qg- P , Qg*- 1 Q^- p+l and 
Qc, Qc~ l 9-->, Qt x respectively. It is considered that the quantizer at level p (e.g. q% p ) is 
finer than the quantizer at level p + l (e. g. if at least one of the quantization 

intervals of the quantizer at level p + l is split into at least two quantization intervals at 
level p. 

25 The number of side quantization intervals of the lowest-rate quantizer q$> p is 

denoted by n and the number of quantization intervals in which an arbitrary side 
quantization interval s?- p of q%< p is divided is denoted by i k . The maximum number of 
intervals in which any side quantization interval s^ p is partitioned over all quantization 
levels is denoted by n p , with L k <N p for any *. Starting from the lowest-rate quantizer 

30 QZ> P , each side quantization interval s% p , ozk P <N is divided into a number of L kp 
quantization intervals s% p k -\ , ozk P _ x <L kp of Q$* p - X . In general, for each side-quantizer q%> p 
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one associates to any x<=s£ p kp i ^ the quantizer index k P) k P _ x ,...,k p . This allows to obtain the 

indices of lower rate quantization by leaving aside components of higher rate 
quantization, similar to the uniform embedded scalar quantizers as described in D. 
Taubman and M. W. Marcellin, JPEG2000 - Image Compression: Fundamentals, 
5 Standards and Practice. Hingham, MA: Kluwer Academic Publishers, 2001 . 

Summary of Cetain Aspects of the Invention 
One aspect of the invention provides a method and device for robust progressive 
image transmission of encoded digital signals over unreliable channels with variable 

10 bandwidth which yield a better rate-distortion performance compared to known Multiple 
Description Uniform Scalar Quantizers (MDUSQ). The signals may correspond to 
detectable physical quantities, such as, but not limited to, pressures, voltages, magnetic 
field strengths, photon energies and counts, that capture conditions at a particular time 
and place. Communication or transmission of those signals allows for sight and sound 

15 reproduction. In one embodiment, a type of embedded scalar quantizers for Multiple 
Description Coding (MDC) systems are introduced, which are referred to as Embedded 
Multiple Description Scalar Quantizers (EMDSQ) hereinafter. 

Another aspect of the invention provides an Embedded Multiple Description 
Scalar Quantizer (EMDSQ) which provides a fine-grain refinable representation of the 

20 input data and are designed, for example, under the constraint of producing double- 
deadzone .central quantizers at each quantization level. The term double deadzone is 
usually used with uniform quantizers to indicate that the size of the central partition about 
zero is equal to the double of the size of the other partitions. In one embodiment, non- 
uniform partitioning can be used and the term double deadzone is extended to include 

25 central partitions so that the double deadzone is within 1.5 to 2.5 times the other 
partitions. Moreover, in one embodiment, a control mechanism for the EMDSQ is 
provided which allows for tuning the descriptions' redundancy for each quantization 
level. 

In one embodiment, the employed mechanism enables: 
30 (1) to control the tradeoff between coding efficiency and resilience to errors, and 

(2) to improve the resilience by increasing the redundancy in the important layers of the 
bit-streams thus resulting in improved experimental results. 

In one embodiment, the control mechanism allows for tuning the redundancy 



between the two or more descriptions for each quantization level. The employed 
mechanism enables the control of the tradeoff between the coding efficiency and error- 
resilience, and provides an increased robustness by improving the error resilience in the 
most important layers of the embedded bit-streams. Instantiations of the proposed family, 
5 for example can be incorporated in a wavelet-based embedded coding system having a 
redundancy-control mechanism. 

In one embodiment, the EMDSQ meets features desired for robust progressive 
image transmission over unreliable channels, such as for example a high redundancy 
level, fine grain rate adaptation and progressive transmission of each description. For an 

10 erasure channel model characterised by burst errors, progressive transmission also 
provides quality improvement for the central reconstruction due to the use of undamaged 
data from partially damaged received side channels. The reconstruction of the central 
channel can be performed if the receiver knows where the burst error occurs. To satisfy 
this requirement, techniques such as inserting synchronisation markers in the bit-stream 

15 can be used. 

In one embodiment, the EMDSQ may be incorporated in any suitable coding 
system such as a DCT coding or, for example, a wavelet-based coding system that 
employs a Quad Tree (QT) coding algorithm as described in A. Munteanu, J. Cornelis, G. 
Van der Auwera, and P. Cristea, "Wavelet-based lossless compression scheme with 
20 progressive transmission capability," Int. J. Imaging Systems and Tech., vol. 10, no. 1, pp. 
76-85, Jan. 1999. 

One aspect of the invention provides a method for transmitting a digital signal, the 
method comprising quantizing a source digital signal to generate with different 
quantizations at least a first and a second bit-stream, of which at least one bit-stream has 

25 been generated by an embedded quantization, transmitting at least one of the at least first 
and second bit-streams and generating a dequantized digital signal from at least parts of 
one of the transmitted at least first and second bit streams, whereby if in the generation of 
the dequantized digital signal the parts of the at least first and second bit-streams are 
combined; the combined dequantized signal is generated by an embedded dequantizer 

30 having at least two quantization levels and having at least one quantization interval at 
each quantization level which is finer than quantization intervals for dequantizing any of 
the at least first and second bit-streams. 

Each quantization level has a quantization rate. A quantization rate corresponds to 



the number of quantization intervals a digital signal is divided into at a certain 
quantization level. At least one bit-stream generated by an embedded quantization may be 
generated by an embedded quantization where at least two quantization intervals at lower 
quantization rate are split into a different number of quantization intervals at higher 
5 quantization rate. At least one bit-stream generated by an embedded quantization may be 
generated by a non-uniform embedded quantization. At least one bit-stream generated by 
a non-uniform embedded quantization may be generated by a non-uniform embedded 
dead zone quantization. At least one bit-stream generated by a non-uniform embedded 
dead zone quantization is generated by a non-uniform embedded double dead zone 
10 quantization. 

Alternatively, at least one bit-stream generated by an embedded quantization may 
be generated by a uniform embedded quantization. At least one bit-stream generated by a 
uniform embedded quantization may be generated by a uniform embedded dead zone 
quantization. At least one bit-stream generated by a uniform embedded dead zone 

1 5 quantization may be generated by a uniform embedded double dead zone quantization. 

Instead of one or more bit-streams, each bit-stream may be generated by an 
embedded quantization. 

Another aspect of the invention comprises selecting end points of quantization 
intervals of a quantizer such that at least one of the end points does not coincide with end 

20 points of a quantization interval of another quantizer. The embedded quantization may 
comprise at least three levels, preferably more than seven levels, and still more preferred 
more than ten levels. The quantizing of the source digital signal may comprise an 
embedded successive approximation quantization at every quantization level. 

Another aspect of the invention provides a device for transmitting a digital signal. 

25 The device comprises a quantizing means for quantizing a source digital signal to 
generate with different quantizations at least a first and a second bit-stream, of which at 
least one bit-stream has been generated by an embedded quantization, and transmitting 
means for transmitting at least one of the at least first and second bit-streams. The 
quantizing means are such that when a dequantized digital signal is generated from at 

30 least parts of one of the transmitted at least first and second bit streams, if in the 
generation of the dequantized digital signal the parts of the at least first and second bit- 
streams are combined, the combined dequantized signal is generated by an embedded 
dequantizer having at least two quantization levels and having at least one quantization 



interval at each quantization level which is finer than quantization intervals for 
dequantizing any of the at least first and second bit-streams. 

At least one bit-stream generated by an embedded quantization may be generated 
by an embedded quantizer where at least two quantization intervals at lower quantization 
5 rate are split in a different number of quantization intervals at higher quantization rate. At 
least one bit-stream generated by an embedded quantizer may be generated by a non- 
uniform embedded quantizer. At least one bit-stream generated by a non-uniform 
embedded quantizer may be generated by a non-uniform embedded dead zone quantizer. 
At least one bit-stream generated by a non-uniform embedded dead zone quantizer may 
1 0 be generated by a non-uniform embedded double dead zone quantizer. 

Alternatively, in one embodiment, a device may be such that at least one bit- 
stream generated by an embedded quantizer is generated by a uniform embedded 
quantizer. At least one bit-stream generated by a uniform embedded quantizer may be 
generated by a uniform embedded dead zone quantizer. At least one bit-stream generated 
15 by a uniform embedded dead zone quantizer may be generated by a uniform embedded 
double dead zone quantizer. 

Each bit-stream may be generated by an embedded quantizer. 

The quantizing means may include means for selecting end points of quantization 
intervals of a quantization such that at least one of the end points does not coincide with 
20 end points of a quantization interval of another quantizer. 

The embedded quantization may comprise at least three levels, preferably more 
than seven levels, and still more preferred more than ten levels. 

The quantizing means may comprise an embedded successive approximation 
quantizer for carrying out an embedded successive approximation quantization at every 
25 quantization level. 

In one embodiment, a device may be located in a node of a telecommunications 
network. 

Another aspect of the invention provides a device for receiving a digital signal. 
The device comprises receiving means for receiving at least a first and a second bit- 
30 stream, and dequantizing means for generating a dequantized digital signal from the 
received first and second bit-streams. The dequantizing means comprise combining 
means for combining, in the generation of the dequantized digital signal, the at least first 
and second bit-streams, the combined dequantized signal being generated by an 



embedded dequantizer having at least two quantization levels and having at least one 
quantization interval at each quantization level which is finer than quantization intervals 
for dequantizing any of the at least first and second bit-streams. 

At least one of the first and the second bit-streams may be generated by an 
5 embedded quantizer where at least two quantization intervals at lower quantization rate 
are split in a different number of quantization intervals at higher quantization rate. At 
least one of the first and second bit-streams generated by an embedded quantizer may be 
generated by non-uniform embedded quantizer. At least one of the first and second bit- 
streams generated by a non-uniform embedded quantizer may be generated by a non- 
10 uniform embedded dead zone quantizer. At least one of the first and second bit-streams 
generated by a non-uniform embedded dead zone quantizer may be generated by a non- 
uniform embedded double dead zone quantizer. 

At least one of the first and second bit-streams generated by an embedded 
quantizer may be generated by a uniform embedded quantizer. At least one of the first 
15 and second bit-streams generated by a uniform embedded quantizer may be generated by 
a uniform embedded dead zone quantizer. At least one of the first and second bit-streams 
generated by a uniform embedded dead zone quantizer may be generated by a uniform 
embedded double dead zone quantizer. 

Each bit-stream is generated by an embedded quantizer. 
20 The dequantizing means may comprise at least three levels, preferably more than 

seven levels, and still more preferred more than ten levels. 

In one embodiment, a device may be located in a node of a telecommunications 
network. 

Another aspect of the invention provides two or more signals generated by any of 
25 the methods as described above. 

Another aspect of the invention provides a telecommunications network 
comprising a device as described above. Another aspect of the invention provides a 
software product such as a computer program product, which when executed on a 
computing device executes any of the methods according to embodiments of the present 
30 invention. In one embodiment, this software product is stored on a signal medium such as 
an optical or magnetic disk or a magnetic tape or similar. In one embodiment, the 
quantizers may have one or more of the following properties: 

1. Multiple Description Scalar Quantizers are provided for communication 



systems using diversity to overcome channel impairments. The Multiple 
Description Scalar Quantizers are Embedded. Hence, the name Embedded 
Multiple Description Scalar Quantizers. 

2. The quantizer corresponding to the central channel can be embedded uniform 
with deadzone. This design propriety enables EMDSQ to outperform the state 
of the art. 

3. For example, the deadzone can be equal to the uniform partitions resulting in a 
uniform quantizer. 

4. Or alternatively, the deadzone can be the double of the uniform partitions 
resulting in a double deadzone uniform quantizer. 

5. The design of EMDSQ allows construction of embedded side quantizers with 
the following propriety: two partition cells at one quantization level can be 
divided into a different number of partitions at a higher quantization level. 

6. In one embodiment, an EMDSQ can possess a redundancy control mechanism 
for each quantization level. This is an extra feature from the previous overall 
control of redundancy. 

These and other characteristics, features and advantages of embodiments of the 
present invention will become apparent from the following detailed description, taken in 
conjunction with the accompanying drawings, which illustrate, by way of example, the 
principles of the invention. This description is given for the sake of example only, without 
limiting the scope of the invention. The reference figures quoted below refer to the 
attached drawings. 

Brief Description of the Drawings 

Fig. 1A illustrates the basic principle of multiple description coding using 
classical fixed-rate scalar quantizers. 

Fig. IB illustrates an example of multiple description coding using classical fixed- 
rate scalar quantizers in which the partition-cells of the central quantizer are obtained by 
intersecting the partition cells of the two side quantizers. 

Fig. 2A illustrates two-channel EMDSQ according to an embodiment of the 
present invention: the side quantizers are <%- p , with the number of side quantizers being 
m = U, and there being two quantization levels p=o,i. q£{x) represents the central 
quantizer. Neglecting the signs, the side and central quantization intervals are of the form 
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ajf 1 , s%\ and , cl A , respectively. 

Fig. 2B illustrates four-channel EMDSQ according to an embodiment of the 
present invention: the side quantizers are Qp p , with the number of side quantizer being 
w=i...4 , and there being two quantization levels />=o,i . The central quantizer is e£ . 
5 Fig. 3 is an illustration of redundancy p versus number of channels for 2<m<i in 

function of a quantization level p, where the total number of quantization levels is p=5, 
and o</?*5. 

Fig. 4 is a four-level representation of a first side quantizer q^ p for two-channel 
EMDSQ for an example with granular region ranging from 0 to 23. 

10 Fig. 5 illustrates a comparison of side and central rate-distortion performance 

between EMDSQ and MDUSQ. 

Fig. 6 illustrates a comparison of side and central rate-distortion performance 
obtained on a "Lena" image with a resolution of 512x512 pixels with an MD-QT code 
employing EMDSQ according to an embodiment of the present invention and MDUSQ 

1 5 according to the prior art respectively. 

Fig. 7 illustrates performance (PSNR in dB) of the central reconstruction of MD- 
QT coding based on EMDSQ according to an embodiment of the present invention 
compared to the one based on MDUSQ for bit rates ranging from 0.125 to 4 bpp. 

Fig. 8 illustrates a transmission system according to an embodiment of the present 

20 invention, with at the transmitter side a plurality of quantizers for generating with 
different quantizations, from a source digital signal, a plurality of bit-streams, and with at 
the receiver side a plurality of dequantizers for generating, from at least partially received 
bit-streams, a plurality of inverse quantized bit-streams which may be combined to 
obtain a better approximation of the source signal. 

25 Fig. 9 illustrates a transmission system according to another embodiment of the 

present invention, with at the transmitter side a quantizer for generating with different 
quantizations, from a source digital signal, a plurality of bit-streams, and with at the 
receiver side a combined central dequantizer for generating, from at least partially 
received bit-streams, a combined inverse quantized bit-stream. 

30 Fig. 10 illustrates an EMDSQ with connected partitions cells and the 

corresponding embedded index assignment strategy for two quantization levels ( /> = l ). 

Fig. 11 illustrates recursive block-matrix decomposition for each quantization 
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level q,0<q<K . 

Fig. 12 illustrates redundancy P versus quantization level < 5 for (a) i q =3 5 
L 2 q -3 < N q < 4 ; (b) 2 < ^ < 5 , jV 9 = 4 * n accordance with an embodiment of the present 
invention. 

5 Fig. 13 shows an EMDSQ index assignment strategy for (b) one and (c) two 

quantization levels employing disconnected partition-cell high-rate quantizers according 
to an embodiment of the present invention. 

Fig. 14 shows a comparative central-channel rate-distortion performance for 
EMDSQ, without disconnected partition-cells and with one (k = q), two (k = \) and three 
10 (a>2) quantization levels with disconnected partition-cell quantizers according to 
embodiments of the present invention. 

Fig. 15 and 16 show implementations of embodiments of the present invention in 
computers and embedded processors. 

15 Detailed Description of Certain Embodiments of the Invention 

The invention will be described with respect to particular embodiments and with 
reference to certain drawings but the invention is not limited thereto but only by the 
claims. The drawings described are only schematic and are non-limiting. In the drawings, 
the size of some of the elements may be exaggerated and not drawn on scale for 

20 illustrative purposes. Where the term "comprising" is used in the present description and 
claims, it does not exclude other elements or steps. 

Furthermore, any terms such as first, second, third and the like in the description 
and in the claims, are used for distinguishing between similar elements and not 
necessarily for describing a sequential or chronological order. It is to be understood that 

25 the terms so used are interchangeable under appropriate circumstances and that the 
embodiments of the invention described herein are capable of operation in other 
sequences than described or illustrated herein. 

Throughout the specification, the terms "EMDSQ" and "MDC" represent 
embedded multiple description scalar quantizers and multiple description coding, 

30 respectively. The terms MDSQ, MD-QT and MDUSQ represent multiple description 
scalar quantizers, multiple description-quad tree and multiple description uniform scalar 
quantizers, respectively. In addition, the terms PDF, PSNR and SDC represent 
probability density function, peak signal to noise ratio and single-description coder, 
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respectively. 

The present invention relates to data communication, more particularly to 
transmission of multiple bit-streams over a channel or over a plurality of channels, 
whereby each bit-stream in itself can reconstruct an approximation of the original data, 
5 for example an approximation of the original image if the source data is image data. 
Hence, one aspect of the invention does not require that all digital streams be used to 
create the original signal at a receiver. However, for a dispersive or noisy environment, 
the more bit-streams that are received and combined with each other, the better the 
reconstructed data, e.g. image is likely to be. Each, or at least a plurality, of the bit- 

10 streams are quantized in a different way. The process according to one embodiment of the 
present invention is illustrated in Fig. 8 and in Fig. 9. The inverse quantization, that is 
dequantization may be done in separate quantizer for each bit stream or in a single 
quantizer for all the streams. 

At the sender or transmitter side of a transmission system, or at any intermediate 

15 part or node of the system where quantization is required, a source digital signal S, such 
as e.g. a source video signal (an image), or more generally any type of input data to be 
transmitted, is quantized in a quantizer Q, or in a plurality of quantizers Qi, Q2, . . Qn> so 
as to form a number of N bit-streams Si, S2, S N . The source signal can be a function of 
one or more continuous or discrete variables, and can itself be continuous or descrete- 

20 valued. The generation of bits from a continuous- valued source inevitably involves some 
form of quantization, which is simply an approximation of a quantity with an element 
chosen from a discrete set. Each of the generated N bit-streams Si, S2, . . Sn may or may 
not be encoded subsequently, for example, entropy encoded, in encoders Ci, C2, C N 
before transmitting them over a channel «. An encoder produces from the source signal a 

25 signal which is compatible with the channel. The channel is the physical medium that 
conducts the transmitted signal. After transmission over the channel the signals are 
received at a receiver or decoder side. A receiver or decoder attempts to recreate the 
message from the received signals. The received signals may be distorted or include 
deletions (e.g. caused by interference). The at least partially received signals Pi, P2, . . Pn 

30 are inverse quantized or dequantized at the receiver side of the transmission system. The 
terms "inverse quantizing" and "dequantizing" have the same meaning, and one can be 
replaced by the other in the present document. The inverse quantization or dequantizing 
may be done in a separate dequantizer Qf 1 , Q2" 1 , Qn" 1 for each bit-stream or in a 
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single dequantizer for all the streams. Each inverse quantized signal can be used alone for 
displaying an approximation of the source digital signal, e.g. for displaying an 
approximation of a source image. Alternatively, at least two inverse quantized signals 
may be combined into an inverse quantized and combined signal which can be used e.g. 
5 for displaying a better approximation of the transmitted image. Alternatively, the inverse 
quantization or dequantizing may be done in a combined inverse quantizer, also leading 
to an inverse quantized and combined signal which can be used e.g. for displaying the 
transmitted image. 

For the two-channel case, the basic principle of multiple description coding using 
10 classical fixed-rate scalar quantizers is illustrated in Fig. 1 A. At the sender site, the input 
source is quantized using two different scalar quantizers Q x and Q 2 , producing two 
different description of the input source, which are sent to the client over two different 
channels. If only one description is received at the client side, depending on the received 
description, the decoder reconstructs an approximation S x or S 2 of the input source using 

15 the inverse quantizers (dequantizers) or Q~ x . If both descriptions are received, the 
decoder reconstructs a different version S c of the input source using the inverse quantizer 
Qc . As shown in the example of Fig. IB, the partition-cells of the central-channel 
quantizer Q c are given by intersecting the partition-cells of the side-quantizers Q x and 
Q 2 . Hence, the central-channel reconstruction S c is better (in distortion sense) than any 

20 of the side-channel reconstructions S x or S 2 . It is important to remark that multiple- 
description coding using scalar quantizers illustrated by Fig. 1A and IB refers to fixed- 
rate (single-rate) quantizers. One embodiment of the invention focuses on embedded side 
and central-channel quantizers, as discussed next. 

Figs. 2A and Fig. 2B illustrate examples of embedded quantizers in accordance 

25 with one embodiment of the present invention. For the two-channel case, it is noticeable 
from Fig. 2A that both the side quantizers Q l f , Q 1 / as well as the central-channel 

quantizer g£ at level 0 are finer than the corresponding quantizers at level 1 , Q 1 / , Q 2 / 

and Q x c respectively. Similarly, for the four-channel case shown in Fig. 2B, the side 

quantizers Q x f , Q] 1 0 , Qs 0 , Qs° as well as the central-channel quantizer g£ at level 0 

30 are finer than the corresponding quantizers at level 1, Qfe 1 , Qp ] and Q l c 
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respectively. This example illustrates that both the side quantizers as well as the central 
quantizers are embedded, that is, the partition cells at a given quantization level are 
embedded in the partition cells at all the higher quantization levels. 

For the quantizers, EMDSQ, according to an embodiment the side quantizers q%- p 

5 are non-uniform embedded quantizers, thus for any o< P <p there exist k±j such that 
L k * Lj . The example depicted in Fig. 2 A illustrates an instantiation of a two-channel 

EMDSQ according to one embodiment of the invention. In view of simplification, only 
two quantization levels />=o,i are considered. It is noticed for instance that the 
quantization intervals slj and slj of the second-channel embedded quantizer qY are 
10 divided respectively into three quantization intervals s£J 0 , and s^ 2 of the higher rate 
quantizer On the contrary, the dead zone sf 1 of the second-channel embedded 
quantizer Qf x is not divided and is transformed into s$ of Qf° . 

A uniform entropy-coded scalar quantizer is optimal for high rates, and nearly 
optimal for lower rates, as described in D. Taubman and M. W. Marcellin, JPEG2000 - 

15 Image Compression: Fundamentals, Standards and Practice, Hingham, MA: Kluwer 
Academic. Publishers, 2001. Furthermore, the above book also describes that, for input 
data with symmetric probability density function (PDF), the rate-distortion behaviour at 
low rates can be improved by widening the quantization interval located around zero, that 
is, by using deadzone uniform scalar quantizers. The rate-distortion function gives the 

20 minimum rate needed to approximate a source signal up to a given distortion. It can be 
noticed that the central quantizer Q } c and Q° c obtained from the side quantizers 1 , Qg 1 

and Qs° , presented in Fig. 2A is a double-deadzone embedded quantizer, i.e. a 

quantizer having equal quantization intervals with a size or width A, except for the 
quantization interval around zero which has a size or width 2A. Hence, it shows the 
25 above-mentioned characteristics of improved rate-distortion behaviour. 

For two-channel EMDSQ, an analytical expression of an embodiment of a 
proposed embedded side-quantizer for the first channel is: 

ei'w- Q¥(x) xe[-^,-^)u[^<) Eq. (1) 

where: 
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QY(x) = sign(x) 



Q¥(x) = sign(x) 



2 P A 2 p 



-(k + p%2) 



H , * / + (1-P%2) 
2-2 p A 2-2^ 2 



Eq. (2) 
Eq. (3) 



The boundary points in Eq. (1) are defined as follows: 

4' = A(2'(3* + 1 + 2p%2) ) , A)$ = A(2*(3* + 2p%2) -« 
5 = A(2'(3* + 3 - p%2) -4) , ^ = A(2" (3* + 1 - p%2) - « . 

In the above equations and formulae: 
[a] denotes the integer part of a , 

a>o is the size or width of a quantization interval for g£ , 
p%2 = p -2-Ip/2], and 
10 ^ (with 5 <i ) determines the size or width of the deadzone. 

[a, b) denotes an interval which is closed in a but open in b 5 that is if xe [a 5 b)then 
a<x<b 

The index kez + determines the size or width of the quantizer granular region, which is the 
interval [yk-A/2, yk-A/2]; source samples in this interval will be approximated within 

1 5 ± A/2 by their quantized values. 

Since the parameter 5 controls the size or width of the central deadzone, the 
central deadzone being one of the quantizer intervals by definition, by tuning its value, 
corresponding families of embedded quantizers may be obtained. It should be noted that, 
when 5 =1/2 , the central quantizer is uniform, while when 5 = 0, the deadzone width is 2A ; 

20 this is the case exemplified in Fig. 2A. Negative values of the parameter 4 are further 
widening the deadzone, as described in the JPEG2000 book mentioned above. 



Generalization of the invention to M channels EMDSQ 

M channel quantizers can only be formulated analytically, since it is not possible 
25 to graphically build an M-dimensional matrix to apply Vaishampayan's method. 

Taking as a starting point equation Eq. (1) that describes an embodiment of the 
first channel quantizer corresponding to the two-channel EMDSQ, it is possible to 
generalise the analytical formula so as to obtain an embodiment for M-channels, as shown 
below: 
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<2S>P(x) xc[-Bg.-i!?)u[ty.tSf) 



Eq. (4) 



with: 



Q%' p (x) = sign(x) 




Eq. (5) 



W(x) = sign(x) 



(M + \-m)M p A M + l-m 



(k + \-p%2) 



and the boundary points are defined as follows: 

5 A£g = A • M p ((A/ + 1)* + m + (M + 1 - m)(/>%2)) , 
= A . AfP ((A/ + 1)* + (M + 1 - m)(p%l)) , 
B$ p = A • M p {{M + I)* + M + 1 - ro(/>%2)) , 
= A ■ A/' ((A/ + 1)* + m - m(/>%2)) , 

where denotes the channel index. 

10 It is to be noted that the particular example of Eq. (1) is derived from Eq. (4) for 

m = 2, m = \ and s=o. 

Based on the expressions for a$ p , , A? n f , Bfif given above, one notices that 
the size or width a {p) of a quantization interval for the side quantizer at level p and 
index m depends on the number of channels M by a< p) =m p a< 0 \ where a (0) is the size or 
15 width of the quantization interval for the highest-rate side quantizer (g-° 9 and A (0) = mA or 

A (0) = (jtf + l-/n)A. 

Fig. 2B depicts the case of four channels (m = a) and two quantization levels 
(o</?si). It is to be noted that the quantization intervals of the side quantizers qz>°, \<m<4 
are embedded respectively in the quantization intervals of the side quantizers Qg l . It is 
20 also to be noted that the central quantizer q p is a double deadzone embedded quantizer 
with quantization interval size or width a^ ) =4 /, a^ ) , where a£°=a is the quantization 
interval size or width of <£ . The negative side of the quantizers is not illustrated, but is a 
mirrored version of the positive side which is shown. 

25 Dependency between redundancy and the number of channels 

All approaches that imply MDC involve creating redundancy in the bit-stream 
transmitted over several channels. By R m ,\zmzM the rates are denoted, and by D m (R m ) the 
corresponding side average distortions over M channels. The average distortion of the 
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central quantizer shall be Do. The standard source coder, i.e. the single-description coder 
(SDC), a coder that implies one source coder and one decoder contrary to MDC which 
implies multiple source encoders and multiple source decoders, minimises D 0 for a given 
rate Rq . Intuitively, the redundancy is the bit-rate sacrificed compared to the SDC coder in 
order to lower the D m distortion. A redundancy function is considered: 

p = IX-^> Eq.(6) 



m=\ 



where Rq is the lowest rate needed by any SDC in order to achieve the central Do 
distortion of the MDC. For a fixed Do, the redundancy ranges from (m-\)Ro (the bit-stream 
is replicated over the M channels) to 0 (the data is totally uncorrelated over the M 
10 channels). 

For the lowest-rate case (see example of Fig. 2B), the number of central quantizer 
quantization intervals is 2(A/+i)-i. Hence, the central quantization rate is *b = iog 2 (2(M+i)-i) • 
Since the number of quantization intervals for all lowest-rate EMDSQ side-quantizers is 
three, their individual rate is R m = iog 2 3 . Thus, formula Eq. (6) for the lowest rate quantizers 

15 can be written Pp =A/iog 2 3-iog 2 (2M+i). Similarly, for level p=p-\, the number of 
quantization intervals of the side quantizers Q%- p - } is w-i, which yields a rate of 
R m = \og 2 (4M-\) . The central quantization rate will be /?b = (iog 2 2A/(A/+i)-i) • Following the 
same reasoning, for quantization level /?, R m = \og 2 (4M p ~ p -i) and Rq = \og 2 (2M p ~ p (M+\)- 1) are 
obtained. Consequently, the redundancy for quantization level p can be expressed as 

20 follows: 

p p =M \og 2 (4M p - p - 1) - \og 2 (2M p ' p (M + 1) - 1) Eq. (7) 

From Eq. (7), one can deduce the analytical expression of the normalised 
redundancy: 

Mio g2 (4^-i) Eq. (8) 

25 One can conclude that for the EMDSQ the redundancy is directly dependent on 

the number of channels. Whereas, in the case of two channels, one can trigger the 
redundancy level by the number of diagonals filled in the index assignment matrix as 
described in V. A. Vaishampayan, "Design of multiple description scalar quantizers," 
IEEE Trans. Inform. Tk, vol. 39, no. 3, pp. 821 - 834, 1993. 

30 A graphic representation of the redundancy versus the number of channels, given 

by Eq. (8), is shown in Fig. 3. The theoretical boundary of the redundancy (A/-i)/% is 
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reached when the stream is replicated over m channels and is represented by the upper 
curve in the graph. It is noticeable that the redundancy between the channels 
monotonically decreases as the quantization level p increases. 

5 Coding scheme 

The use of the EMDSQ according to one embodiment of the invention into a 
wavelet-based coding scheme is illustrated, for the particular case of the number of 
channels being m = 2. A proposed MD-QT coding system encodes the quantizers' output 
by using a customised version of the wavelet-based QT coding of the significance maps 

10 algorithm described in A. Munteanu, J. Cornells, G. Van der Auwera, and P. Cristea, 
"Wavelet-based lossless compression scheme with progressive transmission capability," 
Int. J. Imaging Systems and Tech, vol. 10, no. 1, pp. 76-85, Jan. 1999. This is only one 
example of one particular coding algorithm that can used EMDSQ. Any type of coding 
algorithm, and any type of input source such as for example special domain, wavelet 

1 5 transform or DCT transform, can be used. 

Significance map coding 

By t p is denoted the significance threshold from a coding step corresponding to 
the quantization level Pi o< P <p ; the significance of wavelet coefficients being recorded in 

20 a significance map with respect to the applied threshold t p . By k = (*,,* 2 ) the spatial 
location of the wavelet coefficient from the wavelet transform matrix is denoted, where 
k x and k 2 stand for the row and column index, respectively. By g(k,v) a quadrant with top- 
left co-ordinates k=(*i,* 2 ) and size or width v=(v,,v 2 ) is denoted, where ^ and v 2 represent 
the quadrant width and height respectively. In view of simplification identical power-of- 

25 two quadrant dimensions vi and V2 are assumed, i.e. Vl =v 2 =2 J for some J. The 
corresponding quadrant delimiting binary elements in the significance map p is denoted 
byG£(k,v). The wavelet image w=e(o,v) is a matrix of v^v 2 elements, with 
o = (o,o),v=(k,,k 2 ) . For any wavelet coefficient, its absolute value and sign are denoted as 
w(i) and s(\) respectively, where i=(/, f / 2 ) with os/,<Ki and o*i 2 zv 2 . 

30 The significance of the wavelet coefficients from any g(k,v) e w, v*(i,i) with 

respect to the applied threshold r p is recorded in (#(k,v) and is determined via the 
operator c p : 
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.'fflM -\ l W<*"W Eq.(9) 

It is to be noted that the significance operator o p determines the significance of a 
quadrant but not the significance of a coefficient. For an individual wavelet coefficient 
the significant operator a p is no longer applied, and instead, the quantizer index 
5 allocation operator, denoted by soko) , is utilised. 

The EMDSQ by their structure present the particularity that different quantization 
intervals at quantization level P are divided into different numbers of quantization 
intervals at the quantization level p~\ as shown hereinabove. Thus, it can be deduced that 
in order to perform the index allocation, the wavelet coefficients have to be compared 
10 against the values of the boundary points of quantization intervals at a certain 
quantization level P . It is considered that an arbitrary quantization interval at level P will 
be divided into N quantization intervals at level p-i. The index allocation operator 5 
determines the codeword associated to each quantized coefficient as follows: 

Eq. (10) 



«)) = 



S 2 ifT SA Zw(\)<T St2 
5, ifT dQ <w(\)<T 6tX 



15 where the boundary points are denoted as r 6w , with o<;*<Ar and r 60 <r 61 <...<r 6 „. The 
manner in which the threshold r p and boundary points T 6 n are computed will be 
described below. 

For the first quadtree-partitioning pass, as described in A. Munteanu, J. Cornelis, 
G. Van der Auwera, and P. Cristea, "Wavelet-based lossless compression scheme with 

20 progressive transmission capability," Int. J. Imaging Systems and Tech., vol. 10, no. 1, pp. 
76-85, Jan. 1999, the significance of the wavelet image w is tested with respect to the 
threshold t p . If a /, (W) = i , the significance map q% (0,v) of the wavelet image w is split into 
four quadrants <f h (k /} v/2) , i</<4, each having half the original parent size or width, with 
k, indicating the origin of each quadrant. The descendent significant quadrants are then 

25 further spliced until the leaf nodes (i.e. wavelet coefficients) are isolated. For the leaf 
nodes, the symbols s n (o<hzn) are allocated by applying the index allocation operator 
5(w(i)). Thus, the significance pass records the positions i of all the leaf nodes newly 
identified as significant, using a recursive tree structure of quadrants (or a quad-tree 
structure). 
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Once the positions and the corresponding symbols of the significant leaf nodes are 
encoded during the significance pass, P is set to p-\. Next, the significance pass is 
restarted to update the entire quad-tree structure by identifying the new significant leaf 
nodes. During this stage, only the significance of the previously non-significant nodes and 
5 quadrants, i.e. those for which 8Mi))=s,and <x' +l ((?(k,v)) = o respectively, is encoded, and the 
significant ones are ignored since the decoder has already received this information. 
Subsequently, the corresponding refinement pass is activated for the significant leaf 
nodes. The refinement pass is performed with respect to the corresponding refinement 
threshold T?* m . The described procedure is repeated, until the complete wavelet image is 
10 encoded, i.e. P =o , or until the target bit-rate is met. 



Coding algorithm 

The manner in which the significance thresholds, refinement thresholds and 
boundary points are computed, is illustrated, for the particular case of the number of 

1 5 channels being m = 2 . 

As explained before, the coding passes performed by the proposed MD-QT coding 
system are the significance pass, employing the significance thresholds T p - m 9 o </?</>, 
followed by the refinement pass, utilising the refinement thresholds r*" , with m ,i<™<2 
denoting the channel index for the case with two channels. 

20 For the lowest quantization rate p , the starting thresholds corresponding to each 

channel are t pa =2T and t P2 = t respectively. Since it is not desirable that the quantizer is 
characterised by an overload region, or an unbounded interval, the t value is related to the 
highest absolute magnitude w max of the wavelet coefficients as: 
r = 2 K(^/3)>i Eq.(ll) 

25 Hence, the maximum number of quantization levels is ^=[iog 2 (w max /3)J+i . In 

general, excepting the lowest quantization rate />, the significance thresholds used for 
each channel m,\<m<2 are given by: 

T P-x.m , T m 2 ((x+m-l)%2) (\ 2) 

~ 4 L(* + l + («+l)%2)/2j ^ ^ 

with p-x= P , and xz\ . The values r m are of the form t x =it and r 2 =4T respectively. 
30 Fig. 4 depicts the first channel EMDSQ with granular region ranging from 0 to 24 

(xe[0,24)). The significance map coding is performed with respect to the set of 
thresholds r* 1 with the rate of decay given by Eq. (12). For the two-channel EMDSQ 
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case, except for the highest quantization rate p , the description of the quantizers reveals 
that half of the quantization intervals at level P are divided into three quantization 
intervals at level P -\ , while the other half are not divided. Thus, three index allocation 
operators are considered. In the case P = p , the index allocation operator<x(w(i)) is used to 
assign for the leaf-nodes in the quadtree the symbols s aA and s a 2 as follows: 
s a>2 7£"<w(i)<r£r 



a,i Eq.(13) 

S aA 0<w(\)<T^ m 



where iff = r p > m and rff = it . 

In the case P <p two operators and y(w(i)) are considered, one for each of the 
two quantization interval types. For the quantization intervals that are divided in three, the 
10 index allocation operator p(w(i» is expressed as: 



s Py2 r/f <w(i)<r/; 2 w Eq. (14) 

s PA r/; 0 m <w(i)<r/f 



where the relations between the corresponding quantization interval boundary points are 

Tgf = T$>™ + A { c p) , Tf£ = TP;™ + 3 • a{?> and 7jf f = r p ^; 0 m + 4 - A<f > , where r p P o X ' ffl = ((* + w)%2)2A^" x) , x > 1 . 

Apart from this, for the remaining half of the quantization intervals that are not 
15 divided only one symbol s yA is assigned through the index allocation operator y(w(\)) as 

follows: 

y(w(\)) = S yA forTr b m <w(\)<Tff Eq. (15) 

The relation between the corresponding quantization interval boundary points is 
T yT = T y p b m + 2A c } > where T y p - x - m =((x+m+ \)%i)4A^' x) 
20 The purpose of the refinement pass is to perform the index allocation for 

coefficients that have already been coded as significant at the previous significance 
passes. The index allocation is performed with respect to the new updated values of the 
boundary points. In order to apply the index allocation, the coefficient that must be 
refined has to be rescaled with respect to the refinement pass threshold T r pm given by: 

2 5 T* m = max(r y p j w , Tgf ) . 

In order to improve the compression results, the output of the MD-QT coder 
(significance symbols, quantizer index symbols, signs symbols) may further be entropy 
coded with an adaptive arithmetic coder, as described in I. H. Witten, R. M. Neal, and J. 
G. Cleary, "Arithmetic coding for data compression," Communications of the ACM, vol. 



-22- 

30, no. 5, pp. 520-540, June 1987, that uses four different probability models. One model 
is used to encode the quadrant significance symbols. Another model is used for the sign 
symbol encoding. Finally, another two models are utilised to entropy code the symbols 
generated by the index allocation operators awi» and pmo) respectively. Since the MD- 
5 QT output for the quantization intervals that are not divided is represented by only one 
symbol ^ , , it is completely redundant to further encode these symbols. 

EXPERIMENTAL RESULTS 

To perform a comparison between the EMDSQ according to one embodiment of 
the invention and MDUSQ as described in Guionnet et al., both quantizers are applied on 
a memoryless Laplacian source of a 256x256 matrix of Laplacian random generated 
numbers with zero mean and a=i4.6, simulating a wavelet subband. Fig. 5 shows that 
comparable results are obtained for the side channel(s) and that in one embodiment the 
EMDSQ outperforms MDUSQ for the central channel. Similar experimental results were 
obtained varying the standard deviation within the range 12 < a <90 . 

Similar to EMDSQ, the MDUSQ has been integrated in the MD-QT coding 
scheme, resulting into a common entropy-coding module for both types of quantizers. 
The results shown in Fig. 6 obtained on the Lena image reveal that on the central channel 
the EMDSQ outperforms MDUSQ with 0.52-1.08 dB. Similarly, the results obtained on a 
common image data set given in the Table of Fig. 7 show that in comparison to the prior 
art MDUSQ, the EMDSQ according to one embodiment of the invention provides 
constantly better rate-distortion performances on the central channel for all the rates. In 
one embodiment, the quantizers can provide under certain circumstances at least 1% 
improvement of the dB of peak signal to noise ratio of data processed in accordance with 
embodiments of the invention. 

Controlling redundancy 

In order to reduce bandwidth it would be preferable to reduce any redundancy in 
transmitted signals. In accordance with an aspect of the present invention the level of 
30 redundancy can be adapted depending upon the channel. The embedded bitstreams made 
by such quantizers are preferably progressively refmable. In accordance with an aspect of 
the present invention, the redundancy in information is controlled between descriptions 
on a level-by-level basis, for example at each level. Thus, one aspect of the invention 
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provides an embedded quantizer having means for controlling the amount of redundancy 
between different descriptions at least one quantization level. 

The embedded multiple description scalar quantizers proposed above according to 
the other embodiments of the present invention are quantizers with connected partitions 
5 cells that target a high redundancy level and provide good coding results. In an EMDSQ 
in accordance with further embodiments of the present invention such quantizers can be 
successfully employed for the coarser quantization levels for an increased resilience of 
the multiple descriptions. On the other hand quantizers with disconnected partition cells 
can be employed in order to reduce the descriptions 5 redundancy. Hence, for the less 

10 important layers (corresponding to the finer quantization levels), embedded side 
quantizers with disconnected partition cells producing double-deadzone central quantizers 
can be designed. One aspect of the present invention is the solution to this problem and 
the mixture between these two classes of quantizers, yielding an EMDSQ family. 

For the two-channel EMDSQ, the set of embedded side-quantizers are denoted as 

15 GS , -°,...,G? , ^ 9 ef* +I >---> Qs ,K+p+l 9 withm = i,2, where the quantization level q, K+\zq<>K+p+\ , 
corresponds to the low-rate quantizers with connected partitions cells, while q,o$q<K 
corresponds to the higher-rate quantizers with disconnected partitions cells. In these 
notations p+\ and a:+i denote the number of quantization levels for the embedded 
quantizers with connected and disconnected partition cells respectively. Also, g£ , 

20 e£ +l ,...,e£ +/>+1 denote the set of embedded central-quantizers Q^\q\>ql)=Q)s q -\q\)ViQ 2 s q ~\ql) 
for any quantization level o^s/r+p+i. 

From the analytical expression of the embedded multiple-description scalar 
quantizers with connected partitions cells described above one can derive the following 
index allocation matrix: 



25 l(r)- 



1 2 

3 

4 5 
6 



0 



0 



W-2 3N-1 
3X 



Eq. 16 



where \<r^3N , in represents the number of partition cells contained in the granular region 
of the central quantizer at the quantization level q = K+\ , and p=[\og 2 N]. 

In the EMDSQ according to the present embodiment, the integer entries in the 
index allocation matrix of Eq. 16 are replaced by 5x5 square matrices of consecutive 
30 indices A r =(^) l5Us5 (see Fig. 10). In this generic case, the index allocation matrix is given 
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by: 



Aj A 2 
A 3 



0 



I(A r ) = 



A 4 A 5 



Eq. 17 



0 




For any matrix m we define the operator ™z(M) that determines the number of 
nonzero elements contained in the matrix m . From Eq. 17 it follows that for the central 
5 quantizers at level q = K+\ the sizes of the bounded partitions cells are of the form 
wir(A r ) A c , where a c go * + is the central-channel's step size at the highest rate. Imposing the 
design constraint of obtaining a double-deadzone central quantizer for the level q = K+\ 
implies equal size for all bounded partition-cells. This necessarily implies an equal 
number of nonzero elements for all the index matrices A r , i.e. nnz(\ r ) = const., vr, l < r <> in . 
1 0 Therefore, the cell size for the central quantizer at level q = k + i is A<f +,) = nnz{\ r )& c . 

From the above and the EMDSQ cell size formulas (Eq. 1-3 above) it can be 
deduced that the central channel quantizer is a double-deadzone embedded quantizer with 
the cell size of the form: 



15 for any level q, tc+\zqzK+p+i . Consequently, from the above, one can deduce that the cell 
size for the side channels is of the form a (<?) = 2^ /: - 1 a (/:+!) where A (K+l) = nnz(A r )A c or 

A ( * +1) = 2-™z(A r )A c . 

The example depicted in Fig. 10 illustrates an embodiment of the EMDSQ with 
connected partitions cells for two quantization levels and the corresponding embedded 
20 index assignment strategy. The negative side of the quantizers is a mirrored version of the 
positive side shown in Fig. 10. If ™z(A r )is constant, then q£ and g>c are double-deadzone 
scalar quantizers . 

Starting with the quantization level q = k , quantizers with disconnected partition 
cells are employed in order to reduce the redundancy between the two descriptions. This 
25 corresponds to a reduced error-robustness for the finer quantization levels; however, this 
reduces the rate in comparison to the rate that would be obtained with quantizers with 
connected partition cells. 

At the level q = K we consider each of the s*s square matrices A r as block 
matrices of the form A r =[B^] ls/J ^ defined by the contained blocks b^, is and 



A^=2*" 



nnz(A r )A c 



Eq. 18 
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represented as follow: 

BK nK nK 

Eq. 18 



nK nK nK 

»Z*1 *L K 2 *L K L K 

Moreover, each of the blocks b£ is square matrices of the same size s k =sil k . Similarly, 
at the finer quantization level <7 = /r-i, each block matrix b£ is again of the form: 
5 =[B^" I ] 1SmifSijc _ l for any \<ij<L K , and the contained blocks b£; 1 are of the size 
s k „ x =si{l k l k _{) Recursively, Bfj=[B^]^ m „ £LqA for any \zi,j<L q , and for all the quantization 

levels ^os^/r (see Fig. 11). 

From nm(\ x ) = nnz{\ 2 ) = ... = nnz(A m ) = const, and imposing the design constraint that for 
any quantization level one obtains a double-deadzone central quantizer, yields: 
10 #i«(b*)=/wz(b2j, v/,y,wi,/i \zij,m,nzL q for any [b?mo] and [b*j*[0], where by [0] one denotes 

the zero matrix. 

Following the recursive decomposition of each block matrix b? +1 , \zij<L q+x , one 
obtains L q 2 square blocks of size: 

S,=-f- Eq.19 

15 Notice that for the highest-rate quantization level g = o all blocks b£ xzijzL* are matrices 
of dimension^ = i , i.e. they contain a single element. 

One obtains the cell size at any level q } \<qzK of the double-deadzone central 
quantizer by: 

^f = rmz(B^ c Eq. 20 

20 for any \<ij<L q and [b?] * [0] . 

Consider a block matrix m=[m /: ,] 1jS/js/i i^ . The number of blocks [M iy ]=[0] contained 
in m is determined via the nonzero-blocks operator *z6(m,m, 7 ) . The operator nzb{MM,j) is 
similar to the operator wiz(M) in the case of unitary size blocks m 0 . With this definition, 
for any of the block matrices b? ^[B^ 1 ]^,,^ ( , \<>ij<L q , the number of blocks b*; 1 different 

25 from the zero matrix is given by N q _ x =nzb(B < l j ,B <, J) . Also, we denote by n k = nzb(A r ,B?j) where 

The total number of indices mapped in each b? block matrix at quantization level 
q is «^(B / p=niIo Ar * j f° r r > i*r£3# and \zi,j*L q . Moreover, >™(\)=Tl q=0 M q . 
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Therefore, the total number of indices mapped in the index assignment matrix \(A r ) is 

It can then be shown that the analytical expression of central EMDSQ for any 
quantization level q, o<q<K+p+\ is: 



Qc(x) = sign(x) 



Eq.21 



Ac >2 /( 9 )//(/( 9 )) # jQ9-l-/(<7)"</(<7)) ^ 

where the level function i( q ) = q -K-\ , h(x) denotes the Heaviside unitary step function and 

sign(x) = 2H(x)-\. 

Denote by the rates and by d^rj the corresponding side description 
distortion, where m = i,2. Also, denote byD 0 the central distortion. The standard source 
10 coder, i.e. the single-description coder (SDC) minimizes d 0 for a given rate 

Intuitively, the redundancy is the bit-rate sacrificed by an MDC compared to the SDC in 
order to achieve the same central d 0 distortion: 

p-IL,*.-* Ec l- 22 
One derives the redundancy expression for the quantization levels q,K+\z q <K+p+i and 
15 the SDC rate /?o = iog 2 (3 ■2 K+P+2 ~ <1 -\) and the corresponding side-channel rate is 
/? m = iog 2 (2 -2 K+P+2 ~ q -\). Thus, formula 22 for K+\<q$K+p+\ is given by: 

9q = 2 ■ Iog 2 (2 ■ 2 K+p + 2 -« - 1) - log 2 (3 • 2 K+p+2 -< - 1) Eq. 23 

For the quantization levels q^^q^K employing quantizers with disconnected partitions 
cells, the SDC rate is ^ = iog 2 (3-2 p+1 Y\ K k=q N k -\) and the corresponding side-channel rate is of 

20 the form R m = iog 2 (2 -2 p * l Yl* i+ -0 ■ Thus, formula 22 for o<q <, k is: 

p 9= 2.iog 2 (2.2^n^/^^ ,og 4 3 ' 2 ' +l n^^- 1 ) E * 24 

From Eq. 10 one can deduce the analytical expression of the normalized redundancy: 



">s 2 K +, rLV*-') 



25 One can conclude that for any embodiment of the present invention which is an 
instantiation of the generic EMDSQ family, the redundancy is directly dependent on the 
quantization level. In addition, for all the quantization levels q,o<,q<.K, the redundancy can 
be controlled via the L q and n v parameters, with N q <,i} q . 
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This mechanism is shown in Fig. 12 which depicts the normalized redundancy 
versus the quantization level (as expressed by Eq. 25), for practical instantiations of the 
L q and N q parameters. It is noticeable that the descriptions' redundancy decreases from 

the higher to the lower quantization levels, and moreover, by changing the parameters i q 

5 and N q we can speed the redundancy's rate-of-decay. 

In order to demonstrate the redundancy control mechanism in accordance with the 
above embodiments of the present invention the rate-distortion behavior for several 
instantiations of the generic family of EMDSQ has been determined. The EMDSQ 
instantiations employ one (zoo), two (k = \) and three (a: = 2) quantization levels with 
10 disconnected partition-cell quantizers. In all the cases L q =2 and N q =4 for any q,o<q<K. 

The corresponding index assignment is illustrated in Fig. 13. 

The EMDSQ instantiations have been applied on a memoryless Laplacian source 
of random generated numbers with zero mean and a =44.7 , modeling a wavelet subband. 

Fig. 14 shows that it is possible to speed the distortion's rate-of-decay for the 
15 central channel by decreasing, after a quantization level, the redundancy obtained by 
varying the standard deviation within a broad range of values (i2«y <9o). 

EMDSQ instantiations according to the present embodiment have also been 
incorporated in a practical wavelet coding system that entropy codes the quantizer indices 
using the QuadTree coding algorithm. The central-channel rate-distortion performances 
20 obtained with the different EMDSQ instantiations have been applied on a common data 
set for Lena and Goldhill images. The proposed EMDSQ family according to this 
embodiment allows for controlling the redundancy between two descriptions at each 
quantization level. 

Fig. 15 shows the implementation of a coder/decoder which can be used with 
25 embodiments of the invention implemented using a microprocessor 230 such as a 
Pentium IV from Intel Corp. USA, e.g. in a Personal Computer. The microprocessor 230 
may have an optional element such as a co-processor 224, e.g. for arithmetic operations or 
microprocessor 230-224 may be a bit-sliced processor. A RAM memory 222 may be 
provided, e.g. DRAM. Various I/O (input/output) interfaces 225, 226, 227 may be 
30 provided, e.g. UART, USB, I 2 C bus interface as well as an I/O selector 228. These may 
serve to receive a source digital signal. FIFO buffers 232 may be used to decouple the 
processor 230 from data transfer through these interfaces. A keyboard and mouse 
interface 234 will usually be provided as well as a visual display unit interface 236. 
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Access to an external memory such as a disk drive may be provided via an external bus 
interface 238 with address, data and control busses. The various blocks of the circuit are 
linked by suitable busses 231. The interface to the channel is provided by block 242 
which can handle the encoded signals as well as transmitting to and receiving from the 
5 channel. Encoded data received by block 242 is passed to the processor 230 for 
processing. 

Alternatively, the circuit of Fig. 15 may be constructed as a VLSI chip around an 
embedded microprocessor 230 such as an ARM7TDMI core designed by ARM Ltd., UK 
which may be synthesized onto a single chip with the other components shown. A zero 

10 wait state SRAM memory 222 may be provided on-chip as well as an optional cache 
memory 224. Various I/O (input/output) interfaces 225, 226, 227 may be provided, e.g. 
UART, USB, I 2 C bus interface as well as an I/O selector 228. FIFO buffers 232 may be 
used to decouple the processor 230 from data transfer through these interfaces. A 
counter/timer block 234 may be provided as well as an interrupt controller 236. Access to 

15 an external memory may be provided an external bus interface 238 with address, data and 
control busses. The various blocks of the circuit are linked by suitable busses 231. The 
interface to the channel is provided by block 242 which can handle the encoded signals as 
well as transmitting to and receiving from the channel. Encoded data received by block 
242 is passed to the processor 230 for processing. 

20 Software programs may be stored in an internal ROM (read only memory) 246. 

Software programs for carrying out coding and/or encoding, especially the quantizing and 
dequantizing in accordance with one embodiment of the present invention, including 
redundancy control may also be stored on the system in executable form. In particular 
software programs may be provided for quantizing and dequantizing as well as 

25 redundancy control according to embodiments of the present invention described above to 
be applied to blocks of data to generate two or more streams of encoded data. That is the 
software, for executing on the processor 230 has code for carrying out the function of 
quantizing a source digital signal to generate with different quantizations at least a first 
and a second bit-stream, of which at least one bit-stream has been generated by an 

30 embedded quantization, transmitting at least one of the at least first and second bit- 
streams and generating a dequantized digital signal from at least parts of one of the 
transmitted at least first and second bit streams, whereby if in the generation of the 
dequantized digital signal the parts of the at least first and second bit-streams are 
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combined, the combined dequantized signal is generated by an embedded dequantizer 
having at least two quantization levels and having at least one quantization interval at 
each quantization level which is finer than quantization intervals for dequantizing any of 
the at least first and second bit-streams. Further, code for redundancy control may be 
5 provided. 

Code may be provided so that each quantization level has a quantization rate and at 
least one bit-stream generated by an embedded quantization is generated by an embedded 
quantization where at least two quantization intervals at lower quantization rate are split 
into a different number of quantization intervals at a higher quantization rate. Code may 

10 also be provided so that at least one bit-stream generated by an embedded quantization is 
generated by a non-uniform embedded quantization. Code may also be provided so that at 
least one bit-stream generated by a non-uniform embedded quantization is generated by a 
non-uniform embedded dead zone quantization. Code may be provided so that at least one 
bit-stream generated by a non-uniform embedded dead zone quantization is generated by 

1 5 a non-uniform embedded double dead zone quantization. NCode may be provided so that 
at least one bit-stream generated by an embedded quantization is generated by a uniform 
embedded quantization. Code may be provided so that at least one bit-stream generated 
by a uniform embedded quantization is generated by a uniform embedded dead zone 
quantization. Code may also be provided so that at least one bit-stream generated by a 

20 uniform embedded dead zone quantization is generated by a uniform embedded double 
dead zone quantization, each bit-stream is generated by an embedded quantization. 

The methods described above may be written as computer programs in a suitable 
computer language such as C and then compiled for the specific processor in the design. 
For example, for the embedded ARM core VLSI described above the software may be 

25 written in C and then compiled using the ARM C compiler and the ARM assembler. 
Reference is made to "ARM System-on-chip", S. Furber, Addison- Wiley, 2000. One 
aspect of the invention includes a data carrier on which is stored executable code 
segments, which when executed on a processor such as 230 will execute any of the 
methods according to embodiments of the invention, in particular will execute quantizing 

30 and/or dequantizing as well as redundancy control according to embodiments of the 
present invention described above to be applied to images. The data carrier may be any 
suitable data carrier such as diskettes ("floppy disks"), optical storage media such as CD- 
ROMs, DVD ROM's, tape drives, hard drives, etc. which are computer readable. 



-30- 

Fig. 16 shows the implementation of a coder/decoder which can be used with 
embodiments of the invention implemented using a dedicated quantizer/dequantizer 
module. Reference numbers in Fig. 16 which are the same as the reference numbers in 
Fig. 10 refer to the same components - both in the microprocessor and the embedded core 
5 embodiments. 

Only the major differences in Fig. 16 will be described with respect to Fig. 15. 
Instead of the microprocessor 230 carrying out methods according to one embodiment of 
the invention this work is now taken over by a quantizer/dequantizer module 240. Module 
240 may be constructed as an accelerator card for insertion in a personal computer. The 

10 module 240 has means for carrying out signal coding and/or decoding according to 
embodiments of the present invention described above. These coders and encoders may 
be implemented as a separate module 241, e.g. an ASIC (Application Specific Integrated 
Circuit) or an FPGA (Field Programmable Gate Array) having means for quantizing 
and/or dequnatizing according to embodiments of the present invention. 

15 Similarly, if an embedded core is used such as an ARM processor core or an 

FPGA, a module 240 may be used which may be constructed as a separate module in a 
multi-chip module (MCM), for example or combined with the other elements of the 
circuit on a VLSI. The module 240 has means for carrying out quantising and/or 
dequantizing according to embodiments of the present invention. As above, these 

20 qunatizers/dequantizers may be implemented as a separate module 241, e.g. an ASIC 
(Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array) 
having means for quantizing and/or dequantizing according to embodiments of the 
present invention described above. 

While the invention has been shown and described with reference to preferred 

25 embodiments, it will be understood by those skilled in the art that various changes or 
modifications in form and detail may be made without departing from the scope and spirit 
of this invention. 



